METHOD, SYSTEM, AND COMPUTER PROGRAM PRODUCT 
FOR VISffilUTY CULLING OF TERRAIN 

Inventor: Hansong Zhang 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This applications claims the benefit of priority to U.S. Provisional 

Application 60/267,424 filed February 9, 2001 (incorporated in its entirety herein 
by reference). 

BACKGROUND OF THE INVENTION 
Field of the Invention 
[0002] The present invention relates generally to computer graphics. 

Background Art 

[0003] Computer graphics systems render all kinds of objects for display and 

animation. An object is modeled in object space by a set of primitives (also called 
graphics primitives). Examples of primitives include, but are not limited to, 
triangles, polygons, lines, tetrahedra, curved surface, and bit-map images. Each 
primitive includes one or more vertices that define the primitive (or a fragment) 
in terms of position, color, depth, texture, and/or other information helpful for 
rendering. 

[0004] Rendering terrain data has become especially important in many 

applications, such as, flight simulation and gaming. Terrain elevation is often 
defined by height data. Any type of height data can be used. For example, a 
height field can be defined by a function, h(x, y)y where (x, y) forms a 2-D domain 
and the height function h represent elevation. In one example, the height function 
is often modeled or sampled on a uniform grid in the domain. The samples are 
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then stored as a digital elevation map (DEM) that is essentially a gray-scale image 
representative of height. 
[0005] Visibility culling on a height field involves the detection of height field 

portions (e.g., tiles) and features (e.g., buildings) that camiot be seen from a 
particular viewpoint. There have been many visibility algorithms proposed for 
general scenes and models. See, e.g., Seth J. Teller and Carlo H. 
Sequin, "Visibility Preprocessing for Interactive Walkthroughs," Computer 
Graphics {Proceedings of SIGGRAPH 91\ 25 (4), pp. 61-69, July 1991; Ned 
Greene and M. Kass, "Hierarchical Z-Buffer Visibility," Proceedings of 
SIGGRAPH 93, Computer Graphics Proceedings, Annual Conference Series, pp. 
231-240 (1993, Anaheim, California); and Hansong Zhang, D. Manocha, T. 
Hudson and K. HofF, "Visibility Culling Usmg Hierarchical Occlusion 
Maps," Proceedings of SIGGRAPH 97^ Computer Graphics Proceedings, Annual 
Conference Series, pp. 77-88, August 1997. These alogrithms can be applied to 
terrain data, but do not take advantage of the characteristics of terrain data. Other 
algorithms have been proposed that directly involve terrain data. One approach 
by Max computes horizons at points on a bump map (one application of a height 
field). The result is used to compute shadows on bump mapped surfaces. The 
horizon is detected in eight directions around each sample point. Points that do 
not fall directly in these directions are not considered. See, Nelson L. Max, 
"Shadows for Bump-Mapped Surfaces," Advanced Computer Graphics 
(Proceedings of Computer Graphics Tokyo *86), Tsiyasu L. Kunii, Ed. 1 986, pp. 
1 45- 1 56, Springer-Verlag; and Nelson L. Max, "Horizon Mapping: Shadows for 
Bump-Mapped Surfaces", The Visual Computer, vol. 4, no. 2, pp. 109-1 17, July 
1988. A similar algorithm is applied to triangulated terrain and processes 24 
directions around each point; the result is used to compute bi-directional 
reflection functions. See, B. Cabral, N. L. Max, and R. Springmeyer, 
"Bidirectional Reflection Fimction from Surface Bump Maps", in Computer 
Graphics (SIGGRAPH ' 87 Proceedings), July 1 987, vol. 2 1 , pp. 273-28 1 . These 
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algorithm can be adapted to visibility applications but are limited. To avoid 
visual artifacts, the number of directions they consider has to be increased greatly. 

[0006] For more accurate horizons, an approach by Stewart considers all points 

of the terrain rather than only those that lie in particular directions. See, A. 
James Stewart, "Fast Horizon Computation at All Points of a Terrain With 
Visibility and Shading Applications," IEEE Transactions on Visualization and 
Computer Graphics, 4(1), pp. 82-93. Another approach shows that, when the 
terrain is stored as a dense grid of n rectilinear prisms, one needs to consider 
0(square root(n)) directions to avoid under-sampling. See, Daniel Cohen-Or and 
Amit Shaked, "Visibility and Dead-Zones in Digital Terrain Maps," Computer 
Graphics Forum, 14(3), Blackwell Publishers: Edited by Frits Post and Martin 
Gobel, pp. 171-180. See, also, a similar algorithm using ray tracing. C-H. Lee 
and Y. G. Shin, "An Efficient Ray Tracing Method for Terrain Rendering," 
Pacific Graphics '95, August 1995. 

[0007] Trobec et. al discuss improvements in precision through bi-linear 

recoristruction along the directions, or in speed by using a Bresenham algorithm. 
See, Tomas Trobec, Borut &lik, and Nikola Guid, "Calculation of Visibility from 
Raster Relief Models," 14th Spring Conference on Computer Graphics, 
Comenius University, Bratislava, Slovakia, Edited by Laszl6 Szirmay Kalos, pp. 
257-266(April 1998), and earlier algorithms described by L. De Floriani, P. 
Magillo, "Algorithms for Visibility Computation on Digital Terrain Models," 
Proceedings ACM Symposium on Applied Computing'93, Indianapolis, February 
1993, and L. De Floriani, P. Magillo, "Computing Visibility Maps on a Digital 
Terrain Model, Spatial Information Theory - A Theoretical Basis for GIS," A.U. 
Frank, I. Campari (Editors), Lecture Notes in Computer Science, N.7 1 6, Springer- 
Verlag, 1993, pp. 248-269. In general, many of the above algorithms are 
characterized as line-sweeping algorithms, because lines are explicitly and 
individually traced from the eye outward along selected directions. 

[0008] Terrain visibility algorithms have been proposed. Visibility culling on a 

hierarchially represented terrain is described by Stewart. See, A. James Stewart, 
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"Fast Horizon Computation at All Points of a Terrain With Visibility and Shading 
Applications," IEEE Transactions on Visualization and Computer 
Graphics, 4(1), 1998, pp. 82-93, and A. James Stewart, "Hierarchical Visibility 
in Terrains," Eurographics Rendering Workshop 1997, Springer Wien, Edited 
by Julie Dorsey and Philipp Slusallek, pp. 217-228. Characterization of several 
other terrain visibility algorithms can be found in L. De Floriani, P. Magillo, 
"Visibility Algorithms on Triangulated Digital Terrain Models," International 
Journal of Geographic Information Systems, London, 8, 1, 1994, and Leila De 
Floriani and Paola Magillo, "Horizon computation on a hierarchical triangulated 
terrain model.," The Visual Computer, 7 7 ft), Springer- Veriag 1995, pp. 134-149. 
One approach determines a fuzzy visibility on terrain where a height value is 
represented as intervals instead of a single number. See, Livio Crocetta, Giovanni 
Gallo and Salvatore Spinello, "Visibility in Digital Terrain Maps: a Fuzzy 
Approach," 14th Spring Conference on Computer Graphics, Comenius 
University, Bratislava, Slovakia, Edited by Laszlo Szirmay Kalos, April 1998, pp. 
257-266. Note that these algorithms compute a horizon map (in image or 
geometric form) to support the binary decision whether each point on the terrain 
is visible from the eye point. This is adequate only for determining whether a 
portion of the height field is occluded by other parts of the height field itself. The 
visibility and culling of other objects on the terrain (buildings, vehicles, trees, 
helicopters, etc.) is not accounted for in such a binary decision based on height 
field values. An actual minimum visible height at each height field point is not 
determined as in the present invention. 
[0009] What is needed is an improved visibility algorithm for culling terrain data. 

BRIEF SUMMARY OF THE INVENTION 

[0010] The present invention provides an improved visibility algorithm for 

culling terrain data. A method, system and computer program product for 
visibility culling of terrain is provided. A height field is perspective modulated. 
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An occlusion height field is generated based on an orthographic height 
propagation of the perspective modulated height field. Graphics data is then 
culled based on the generated occlusion height field. 

[0011] In one embodiment, a method for visibility culling includes modulating 

a first height field as a function of distance to obtain a perspective modulated 
height field. In one example, the first height field is modulated as an inverse 
function of distance to obtain the perspective modulated height field. In another 
example, the modulating step modulates the first height field as an inverse 
function of distance scaled by a scaling factor to obtain the perspective modulated 
height field. In one example implementation, a perspective modulation disk is 
used to modulate the first height field along radial slices from a viewpoint. 

[0012] In one embodiment, texturing (and blending) operation can be used to 

accelerate the perspective modulation. This has an advantage processing 
operations can be hardware accelerated on commercial off the shelf graphics 
hardware. In one example, the modulating step is carried out by drawing a 
perspective modulation disk of radial slices on top of a first height field centered 
at a viewpoint V. Texture from a one-dimensional texture is mapped to the radial 
slices to obtain the perspective modulated height field, 

[0013] With respect to the orthographic height propagation, in one embodiment, 

a method further includes generating an occlusion height field based on an 
orthographic height propagation of the perspective modulated height field. In one 
example, the generating step includes comparing height values of the perspective- 
modulated height field at first and second sample locations separated by a 
propagation distance d, the first location being closer to the viewpoint than the 
second location. The height value of the second location is then updated v^th the 
greater height value determined in the comparison. 

[0014] In one embodiment, a series of iterations are performed to generate an 

occlusion height field according to the invention. For example, each iteration can 
be a rendering or drawing pass through a graphics pipeline. Each iteration 
involves comparing and updating height values at multiple sampling locations 
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along the lengths of radial shces. Height propagation is incremented by an 
incremental distance which can be fixed or varied for each iteration. 

[0015] Like perspective modulation, generating an occlusion height field 

according to the present invention can also be carried out using texturing and 
blending and can be hardware-accelerated. According to a further feature, a shift 
disk or shift texture is used. The first height field is stored as a first height field 
texture. The perspective modulated height field is stored in a color channel of 
a fi-ame buffer. A method then draws a first shift disk including texture mapping 
texels from the first height field texture, blends the texture mapped texels and the 
color values of the perspective modulated height field stored in the color chaimel 
of the frame buffer to obtain an updated shift disk. The updated shift disk has 
updated color values representing the updated height values based on a maximum 
comparison and texture coordinates shifted by an incremental distance. 

[0016] In one embodiment, a system for visibility culling is provided. The 

system includes modulating means and generating means. The modulating means 
modulates a first height field as a function of distance to obtain a perspective 
modulated height field. The generating means for generates an occlusion height 
field based on an orthographic height propagation of the perspective modulated 
height field. 

[0017] In one embodiment, a system includes host computer, and a graphics 

subsystem coupled to the host computer. The host computer includes a visibility 
culling controller. The visibility controller controls the graphics subsystem to 
modulate a first height field as a function of distance to obtain a perspective 
modulated height field and to generate an occlusion height field based on an 
orthographic height propagation of the perspective modulated height field. 

[0018] In one example, the graphics subsystem includes a texture mapping unit 

and a blending unit. The visibility culling controller controls the texture mapping 
unit to modulate a first height field as a function of distance to obtain a 
perspective modulated height field and controls the texture mapping unit and the 
blending unit to generate the occlusion height field based on an orthographic 
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height propagation of the perspective modulated height field. The texture 
mapping unit and the blending unit carry out processing operations in hardware. 
The texture mapping unit modulates a first height field as a function of distance 
to obtain a perspective modulated height field in a processing operation 
implemented at least in part in hardware. The texture mapping unit and the 
blending unit generate the occlusion height field based on an orthographic height 
propagation of the perspective modulated height field in another processing 
operation implemented at least in part in hardware. 

[0019 j Another embodiment is a system having a visibility culling controller that 

controls a graphics subsystem. 

[0020] Another embodiment is a visibility culling controller having first and 

second control logic. The first control logic enables a graphics subsystem to 
modulate a first height field as a function of distance to obtain a perspective 
modulated height field. The second control logic that enables a graphics 
subsystem to generate an occlusion height field based on an orthographic height 
propagation of the perspective modulated height field. 

[0021] Another embodiment is a computer program product having a computer 

useable medium with computer program logic recorded thereon for enabling a 
processor to render a computer scene. The computer program logic includes first 
computer readable code that enables a processor to modulate a first height field 
as a function of distance to obtain a perspective modulated height field, and 
second control logic that enables a processor to generate an occlusion height field 
based on an orthographic height propagation of the perspective modulated height 
field. 

[0022] Another embodiment is a visibility culling controller having first control 

logic that modulates a first height field as a function of distance to obtain a 
perspective modulated height field, and second control logic that generates an 
occlusion height field based on an orthographic height propagation of the 
perspective modulated height field. 
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[0023] Another embodiment is a system including a visibility culling controller, 

a first height field, and a graphics pipeline, such as, an OPENGL pipeline. 

[0024] The present invention then provides a visibility culling algorithm for 

height fields that takes full advantage of the properties of terram data. The 
algorithm is based, in essence, entirely on image processing of height field data, 
achieved in real-time through rendering and in one example per-pixel operations. 

[0025] Unlike line-sweeping algorithms, an embodiment of the present invention 

does not have to trace individual lines, but instead can use texture mapping to 
achieve parallel processing of all height field points. Also, in one example, 
bilinear texture mapping automatically interpolates height values to achieve better 
reconstruction from height field data. 

[0026] Further features and advantages of the present invention, as well as the 

structure and operation of various embodiments of the present invention, are 
described in detail below with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0027] The accompanying drawings, which are incorporated herein and form part 

of the specification, illustrate the present invention and, together with the 
description, further serve to explain the principles of the invention and to enable 
a person skilled in the pertinent art to make and use the invention. In the 
drav^ngs, like reference numbers indicate identical or functionally similar 
elements. Additionally, the left-most digit(s) of a reference number identifies the 
drav^ng in which the reference number first appears. 

[0028] FIG, 1 is a diagram that illustrates an examiple of a terrain defined by a 

height field. 

[0029] FIG. 2 is a two-dimensional view that illustrates an example radial slice 

of the height field extending from a viewpoint in a plane perpendicular to groimd. 
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[0030] FIG. 3A is a diagram that illustrates an occlusion height field generated 

by a process of perspective height propagation performed with respect to the 
height field in the radial slice of FIG. 2. 

[0031] FIG. 3B is a diagram that illustrates an occlusion height field generated 

by a process of orthographic height propagation performed with respect to the 
height field in the radial slice of FIG. 2. 

[0032] FIG. 4 is a flowchart of a method for height field visibility culling 

according to the present invention. 

[0033] FIG. 5 is a diagram of an example graphics architecture in an 

implementation of the present invention. 

[0034] FIGs. 6A and 6B show examples of a radial slice and perspective- 

modulated occlusion height field generated according to the present invention. 

[0035] FIG. 7 is a diagram that illustrates an example of orthographic height 

propagation of a perspective-modulated height field according to the present 
invention. 

[0036] FIGs. 8A, 8B, 8C, and 8D are routines involving texturing and blending 

according to embodiments of the present invention. 
[0037] FIG. 9 A shows a perspective modulation disk in a hardware-accelerated 

embodiment of the present invention. 
[0038] FIG. 9B shows an example texture coordinate shift disk in a hardware- 

accelerated embodiment of the present invention. 
[0039] FIG. 10 is a diagram of a hardware-accelerated routine according to an 

embodiment of the present invention. 
[0040] FIG. 11 shows four images representing height field information 

generated during steps in the hardware-accelerated routine of FIG. 10. 
[0041] FIG. 12 is a graph that plots examples of an inverse function and scaled 

inverse function used in perspective modulation according to the present 

invention. 
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[0042] FIG. 13 is a diagram that illustrates the equivalence of a perspective- 

modulated occlusion height field generated according to the present invention 
and an occlusion height field generated by perspective height propagation. 

[0043] FIG. 1 4 is a block diagram of a host and graphics subsystem according to 

an embodiment of the present invention. 

[0044] FIG. 15 is a block diagram of a computer system according to an 

embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

1 . Overview 

[0045] The present invention provides an algorithm for visibility culling based 

on terrain data. Visibility determination on height fields is treated as a process 
of perspective height propagation from a given viewpoint. The result of such 
propagation is an occlusion height field. If an object is covered by the occlusion 
height field, it is not visible. 

[0046] The inventor has recognized that perspective propagation of an original 

height field is equivalent to orthographic height propagation of a perspective 
modulated original height field. Further, such orthographic height propagation 
of a perspective modulated original height field according to the present invention 
is readily supported by existing graphics hardware and can be hardware- 
accelerated. In one embodiment, to compute an occlusion height field, a 
perspective modulation is applied to the original height field through texture 
mapping. Orthographic height propagation is performed by shifting texture 
coordinates in radial directions fi-om the viewpoint and using blending to keep 
greater modulated heights. In one example implementation, an occlusion height 
field is generated through hardware-accelerated, multi-pass per-pixel operations. 

2. Terminology 

[0047] The follov^ng terms are defined so that they may be used to describe 

embodiments of the present invention. As used herein: 
[0048] The terms "terrain" or "terrain data" are used interchangeably to refer data 

representative of a terrain including, but not limited to, a height field. 
[0049] The term "height field" is used broadly herein and can include any type 

of height or elevation data, such as, a height image, height function, or digital 

elevation map (DEM). 
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[0050] "Image" or "scene" means an array of data values. A typical image might 

have red, green, blue, and/or alpha pixel data, or other types of pixel data 
information as known to a person skilled in the relevant art. 

[0051] "Pixel" means a data structure, which is used to represent a picture 

element. Any type of pixel format can be used. 

[0052] "Texture image," "texture," or "texture map" are used interchangeably to 

refer to an array of texels addressed by texture coordinates. A "texel" is a texture 
element. In some cases, texels are also referred to herein as "pixels" when the 
texture is used in pixel processing operations. In this way, the terms '^texel" and 
"pixel" are sometimes used interchangeably as is often done in the computer 
graphics field. 

3. Height Propagation and Occlusion Height Fields 

[0 053] It helpful to first compare perspective and orthographic height propagation 

with respect to a radial slice along a height field. FIG. 1 is a diagram that 
illustrates an example of a terrain 100 defined by a height field (h) over a two- 
dimensional domain (x,y). A viewpoint V is a point in terrain 100, such as, the 
eye point or any other reference point, from which visibility in a scene is 
determined. FIG. 2 is a two-dimensional view that illustrates an example radial 
slice 200 of a height field extending along a radial direction r from a viewpoint 
V in a plane perpendicular to ground. Radial slice 200 is the intersection of the 
height field with a half-plane defined by an arbitrary direction on the ground and 
the vertical line passing the viewpoint and perpendicular to the grotind. Note that 
this has nothing to do with an actual view-frustum set-up that can have arbitrary 
pitch and roll while still using the visibility algorithm of the present invention. 

[0054] In the following discussion, for clarity, assume the height field domain is 

the X-Y plane, and heights are along the Z-axis. Also, in this example, assume 
that the viewpoint, F, has height 0; to enforce this, one can subtract the height of 
the viewpoint, hy, from the original height field. For a given K, each point (x, y) 
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in the domain of the height field has a minimum visible height, i.e., the minimum 
elevation so as to be visible from V. A minimum visible height ftmction h(x, y) 
is the occlusion height field. If an object's (or its bounding box's) maximum 
heights are below the corresponding heights in the occlusion height field, then the 
object is not considered visible from the viewpoint. 

[0055] FIG. 3 A is a diagram that illustrates an occltision height field 300 

generated by a process of perspective height propagation performed with respect 
to radial slice 200. In a perspective height propagation, the minimum visible 
height at each point in the domain of the height field for radial slice 200 is 
computed to determine occlusion height field 300. Objects, terrain, or other 
geometry in areas below the occlusion height field 300 are not visible and are 
culled. Perspective height propagation is desirable as it produces an occlusion 
height field that accurately excludes what is not visible from a viewpoint V. 
Drawbacks of perspective height propagation are that it is computationally 
expensive and prohibitive for many graphics systems and real-time applications. 

[0056] Compare perspective height propagation with orthographic height 

propagation. FIG. 3B is a diagram that illustrates an occlusion height field 310 
generated by a process of orthographic height propagation performed v^dth respect 
to radial slice 200. In orthographic height propagation, heights are simply 
compared in a near-to-far order. The greater height values determined in the 
comparisons define occlusion height field 310. This approach can discover some 
occlusion, for example, higher peaks closer to the viewer can occlude lower ones 
located farther away. One advantage over perspective height propagation is that 
the comparison operations used on orthographic height propagation can be 
computationally inexpensive. Such orthographic height propagation is usually 
too conservative. Occlusion is often caused by perspective effects (such as, lower 
heights close to the eye which can occlude high peaks in the distance) which 
would not be culled by an occlusion height field generated by orthographic height 
propagation. FIG. 3B shows an example point A which is not effectively culled 
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by orthographic height propagation compared to the perspective height 
propagation. 

[0057] The present invention is first described with respect to an overall method 

(FIG. 4), a graphics architecture implementation for carrying out the method 
(FIG. 5), and examples (FIG. 6A, 6B, and 7). Embodiments of the present 
invention using texturing and blending that can be hardware-accelerated are then 
described (FIGs. 8A-8D). Reference is made to an example perspective 
modulation disk (FIG. 9A) and an example texture coordinate shift disk 
(FIG. 9B). A further example hardware-accelerated routine (FIG. 1 0) compatible 
with an OPENGL implementation is described. Examples of height field 
information generated during steps in the hardware-accelerated routine are shown 
(FIG. 11). Examples of an inverse function and scaled inverse function used in 
perspective modulation according to the present invention are discussed and 
shown in FIG. 12. A more detailed mathematical explanation of the equivalence 
of a perspective-modulated occlusion height field generated according to the 
present invention and an occlusion height field generated by perspective height 
propagation is presented and illustrated with respect to a diagram shown in 
FIG. 13. Finally, an example host and graphics subsystem (FIG. 14) and an 
example computer system (FIG. 15) that can carry out embodiments of the 
present invention are described. 

4. Visibility Culling Based on Perspective Modulation and Orthographic 
Height Propagation 

A. Method 

[0058] FIG. 4 shows a method for visibility culling 400 according to an 

embodiment of the present invention (steps 410-430). FIG. 5 shows an example 
graphics architecture 500 for carrying out the method for visibility culling 400. 
Architecture 500 is one implementation and is not intended to limit the present 
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invention. FIGs. 6A and 6B show examples of a radial slice and a perspective- 
modulated occlusion height field generated according to the present invention. 

(1) Perspective Modulation 

[0059] In step 410, a first height field is modulated as a function of distance to 

obtain a perspective modulated height field. This step is also referred to as 
"perspective modulation." The first height field can be any height data. In one 
example, the first height field represents a height field having a zero height at a 
viewpoint V. If a viewpoint V has a height hv, then the value hv is substracted 
from all samples in an original height field. 

[0060] Any function of distance can be used in perspective modulation depending 

upon a particular effect desired or needed. In one embodiment, the distance 
function of distance is based on the inverse of the distance d between a height 
field sample location and a viewpoint. In one embodiment, the distance function 
is equal to the inverse of the distance d. In another embodiment, the distance 
function is equal to the inverse of the distance d scaled by a scale factor (f^. The 
scale factor can be set to any desired number, such as, f^j = 20, as shown in FIG. 
12. 

(2) Orthographic Height Propagation 

[0061] In step 420, an occlusion height field is generated based on an 

orthographic height propagation of the perspective modulated height field. In one 
embodiment, orthographic height propagation is carried out along a nximber of 
radial slices in the perspective modulated height field. The radial slices extend 
from the viewpoint (which can be either the eye point, eye, camera point,or other 
desired reference point). A comparison of height values is made along each 
radial slice. The greater height value is updated and propagated. 
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[0062] For example, consider two samples of a perspective modulated height 

field along a radial slice. Each propagation involves shifting sample locations by 
an incremental distance. The incremental distance can have a constant or variable 
magnitude. For example, a first sample has a height h(d), v^here d is a distance 
from the viewpoint V to the location of the first sample along a radial slice. A 
second sample has a height h(d + Ad), where Ad is equal to the magnitude of the 
incremental distance for a given propagation iteration. A value nAd, where n is 
an integer or scalar, can also be used in place of Ad to vary the incremental 
distance. In step 420, the values h(d) and h(d + Ad) are compared. The greater 
value of the two is used to update the height value at the second sample location 
h(d + Ad). FIG. 7 shows one example step in orthographic height propagation of 
step 420 according to an embodiment of the present invention. Two arbitrary 
azimuth angles and a slice of the perspective-modulated height field are shown. 

[0063] The orthographic height propagation then proceeds to a third sample 

location at an incremental distance from the second sample location. The height 
value at the third sample location is then updated with the greater of the height 
values at the second and third sample locations. Such propagation continues until 
the end of the radial slice, and until a number of radial slices have undergone 
orthographic height propagation. In this way, height values are pushed in radial 
directions away from a viewpoint. The resulting updated height values along the 
radial slices define an occlusion height field according to the present invention. 
An occlusion height field of the present invention is also referred to herein as a 
perspective-modulated occlusion height field. 

[0064] The above description of is made by describing comparisons made along 

a number of radial directions. This is not intended to limit the present invention. 
The comparisons can be made according to the present invention through texture 
mapping and blending. In this case, comparisons are carried out over the 
perspective-modulated height field domain using texture mapping and blending 
instead of considering each radial direction separately. 
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[0065] FIG. 6A shows an example image representing a radial slice in a plane 

orthogonal to ground, FIG. 6B is a diagram that shows an example original 
height field 610. The diagram also shows a perspective modulated height field 
620 (obtained in step 410), and a perspective-modulated occlusion height field 
630 (obtained in step 420), according to one embodiment of the present 
invention. 

(3) Culling 

[0066] In step 430, graphics data is culled based on the occlusion height field 

generated in step 420. In step 430, culling is performed based on an occlusion 
test. Any known occlusion test can be used. 

(4) Occlusion Tests 

[0067] To test whether an object is occluded, vertices on the object's bounding 

volume are transformed in the same manner as perspective modulation (i.e. by a 
distance function, such as, multiplication by \fd). Let^ denote the area covered 
by the bounding volume's perpendicular projection on to the base of the terrain. 
If the maximum heights of such a transformed bounding volume are lower than 
all the heights in region A of the perspective-modulated occlusion height field, the 
object must be hidden. 

[0068] Further simplification can make height comparisons cheaper (but more 

conservative). For example, an axis-aligned bounding box can be computed 
around a perspective-transformed bounding volume. The axis-aligned bounding 
box is then used in occlusion tests in place of the perspective-transformed 
bounding volume. 

[0069] The occlusion height field may be filtered down using a maximum 

operator to lower resolutions to facilitate faster tests. Further, a hierarchy of 
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occlusion height fields can be derived from the original to support hierarchical 
tests. 

[0070] The culling in step 430 can be performed early in a graphics processing 

pipeline to reduce the amount of geometry and terrain which must be rendered. 

B. Software, Firmware, and/or Hardware Implementation 

[0071] The present invention can operate in any computer processing 

environment including any graphics processing environment. In particular, the 
present invention (including one or more steps of routine 400 as described above) 
can be implemented in software, firmware, hardware, or in any combination 
thereof 

C. Example Environment 



[0072] One example environment for the present invention is a computer 

graphics environment. FIG. 5 illustrates a block diagram of an example computer 
architecture 500 in which the various features of the present invention can be 
implemented. FIG. 5 is an example only and not intended to limit the present 
invention. It is an advantage of the invention that it may be implemented in many 
different ways, in many environments, and on many different computers or 
computer systems supporting graphics processing. 

[0073] Architecture 500 includes six overlapping layers. Layer 510 represents 

a high level software application program. Layer 520 represents a three- 
dimensional (3D) graphics software tool kit, such as OPENGL PERFORMER, 
available from Silicon Graphics, Incorporated, Mountain View, California. Layer 
530 represents a graphics application programming interface (API), which can 
include but is not limited to OPENGL, available fi-om Silicon Graphics, 
Incorporated. Layer 540 represents system support such as operating system 
and/or windowing system support. Layer 550 represents firmware. Finally, layer 
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560 represents hardware, including graphics hardware. Hardware 560 can be any 
hardware or graphics hardware including, but not Umited to, a computer graphics 
processor (single chip or multiple chip), a specially designed computer, an 
interactive graphics machine, a gaming platform, a low end game system, a game 
console, a network architecture, server, et cetera, 

[0074] As will be apparent to a person skilled in the relevant art after reading the 

. description of the invention herein, various features of the invention can be 
implemented in any one of the layers 510-560 of architecture 500, or in any 
combination of layers 5 10-560 of architecture 500. In particular, one or more of 
steps 410-430 can be implemented in any one of the layers 510-560 of 
architecture 500, or in any combination of layers 510-560 of architecture 300. 
Layers 5 1 0-560 are illustrative and one or more of layers 5 1 0-560 can be omitted 
depending upon a particular system configuration. 

[0075] In one embodiment, a height-based visibility culling module 505 (also 

called a visibility culling controller) is provided according to the present 
invention. The height-based visibility culling module 505 provides control steps 
necessary to carry out routine 400. The height-based visibility culling module 
505 can be implemented in software, firmware, hardware, or in any combination 
thereof. As shown in FIG. 5, in one example implementation height-based 
visibility culling module 505 is control logic (e.g., software) that is part of an 
application layer 510 that provides control steps necessary to carry out routine 
1 00. In alternative implementations, height-based visibility culling module 505 
can be implemented as control logic in any one of the layers 510-560 of 
architecture 300, or in any combination of layers 5 1 0-560 of architecture 500. In 
particular, height-based visibility culling module 505 can control the carrying out 
of one or more of steps 410-430 in any one of the layers 510-560 of architecture 
500, or in any combination of layers 510-560 of architecture 500 as would be 
apparent to a person skilled in the art given this description. These example 
system environments are illustrative and not intended to limit the present 
invention. 
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6. Hardware-Accelerated Visibility Culling Based on Perspective 
Modulation and Orthographic Height Propagation 

[0076J According to a further embodiment of the present invention, hardware- 

accelerated visibility culling based on perspective modulation and orthographic 
height propagation is provided. Texturing and blending operations are used to 
allow perspective modulation and orthographic height propagation as described 
in steps 410 and 420 to be accelerated in graphics hardware, 

A. Perspective Modulation with Texture Processing 

[0077] FIG. 8A shows one embodiment where hardware acceleration of the 

perspective modulation step 4 1 0 is carried out using a perspective modulation 
disk and a one-dimensional (1-D) texture (steps 810-820). The 1-D texture 
contains inverse distance values (1/d). FIG. 9A shows an example perspective 
modulation disk 900 which is a triangle fan. Point A is an arbitrary vertex on the 
boundary and |r| is the radius of disk 900. The center texture coordinate is 0. 
Other points on disk 900 have a texture coordinate equal to the magnitude of the 
radius at the respective point. For example, the texture coordinate for point A is 
equal to |r| as shown in FIG. 9A. 

[0078] In step 810, the perspective modulation disk is drawn on top of the 

original height field centered at viewpoint V. The 1-D texture is applied in a 
texture mapping operation to perspective modulate the original height field along 
radial directions or slices centered at the viewpoint and to obtain a perspective 
modulated height field image in a firame buffer color channel (step 820). The 
perspective modulated image is then stored as a perspective modulated height 
field texture (step 830). 
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B. Orthographic Height Propagation with Texture Processing and 
Blending 

[0079] In one embodiment, hardware acceleration of the orthographic height 

propagation step 420 is carried out through texturing and blending. Moving 
values from one location to another is exactly what texture mapping is for. 
Combining the incoming value from texture mapping and an existing value is a 
typical blending operation. 

[0080] More specifically, a propagation of distance Ad for all pixels on the terrain 

is carried out in two steps. First, the height field is used as a texture map. The 
value h(d) is brought to a distance d+Ad by shifting texture coordinates in radial 
directions from the viewpoint V. Second, the frame-buffer is initialized with the 
original height field. A blending mode which saves the larger of the source (i.e. 
the incoming value from the shifted height field) and destination performs the 
comparison. A benefit of such a texture mapping based algorithm is that by using 
bilinear filtering when doing texture mapping, one can effectively reconstruct 
height field values from samples using bilinear interpolation. This provides 
higher accuracy as compared to treating the height field as a collection of step 
functions. 



(1) Texture Coordinate Shift 



[0081 1 According to a further feature of the present invention, two embodiments 

for shifting texture coordinates in radial directions from the viewpoint in the 
orthographic height propagation step 420 are provided. The first embodiment 
involves use of a shift disk. The second embodiment involves uses of a shift 
texture. Each of these example implementations are discussed and described 
below with respect to FIGs. 8B-8D, 9B, and 10. 
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(2) Shift Disk 

[0082] Conventionally, texture coordinates are specified on a per- vertex basis and 

interpolated during scan-conversion. Let the coordinates on the height field 
texture be (w, v), 0 ^ w ^ 1 , 0 ^ v ^ 1 , and let the dimensions of the height field 
in the world space be x £ (assuming a square height field to simplify the 
discussion but not limit the present invention). A distance difference of Ad in the 
world space corresponds to a shift in texture coordinates by .y, ^ = Ad / Z,. To shift 
texture coordinates by an amoimt s in radial directions, away from the center, a 
2-D shift disk 910 is constructed as illustrated in FIG. 9B. 

[00831 When disk 910 is drawn with the original height field as a texture, the 

height values are "pushed away" ft-om the viewpoint by Ad. When disk 910 is 
drawn on top of the original height field, with the disk centered at the eye's 
vertical projection onto the X- 7 plane, a blending operation compares values and 
keeps the greater. In this way, a hardware-accelerated comparison of h(d) and 
h(ci+Ad), propagating heights by distance Ad, is carried out. 

[0084] The full propagation of heights, though, requires that heights be pushed 

all the way to the edge of the height field. More precisely, to compute an 
occlusion height field covering the entire height field domain, all heights closer 
to the viewpoint have to be compared with all heights farther away in the same 
radial direction from the eye. Given the basic operation of height propagation by 
Ad, a fiill propagation is performed by doing an incremental distance Ad at a time, 
until the height value at the eye position reaches the ftirthest point on the height 
field's edge. Evidently, if the height field edge point ftirthest from the viewpoint 
is at distance dp, then the number of steps required \sN = dpi Ad. 

[0085] In examples, a fiill propagation can be constructed in either of the 

following two approaches, whichever is faster on a particular piece of hardware. 
The propagation distance remains fixed or varies in each successive propagation. 
In the first fixed propagation distance way, an iterative replacement of the height 
field texture is made. After every step (a propagation of distance Ad), the original 
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texture is replaced with the resuhing one. The algorithm proceeds to the next 
propagation of Ad with the same shift disk, the result of which is a propagation 
of 2Ad; and so on. In the second variable propagation distance approach, the 
amount of texture coordinate shifts is increased by modifying the disk after every 
step. For example, for the n-th step, \ <, ^ disk is used that shifts texture 
coordinates by s = n Ad/L. In other words, at step n, h(d) is shifted and compared 
to h(d+n Ad). 

[0086] The first approach is preferable when there is a fast way of turning the 

rendering result into a texture, e.g. when the hardware allows direct rendering to 
a texture. The geometry of the disk does not need to be modified in between steps 
so that the disk can exist in hardware-optimized forms like a display list that can 
be passed to an OPENGL graphics system. If converting rendered images to 
textures is a slow operation for available graphics resources, then the second 
approach has the advantage of always using the same height field texture. 

(i) Height Propagation Fixed at Each Iteration 

[00871 FIG. 8B shows a routine for carrying out step 420 using a shift disk with 

an incremental height propagation fixed at each iteration (steps 840-848). First, 
geometry data is set up defining a shift disk. For example, in an OPENGL 
environment the geometry data can be provided in a display list. The shift disk 
includes vertices having texture coordinates that identify a fixed texture 
coordinate shift along radial directions (step 840). 

[0088] In step 842, a perspective modulated height field is bound as a first 

texture. This identifies the perspective modulated height field as a first texture 
to be used in texture mapping in a graphics pipeline rendering pass. 

[0089] In step 844, a frame buffer is initialized with a reference height field. The 

reference height field is the original height field minus the eye height at a 
viewpoint. 
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[0090] Heights are propagated by a fixed incremental distance Ad. For each 

height propagation, texture mapping is performed at the shift disk vertices to 
access corresponding texels in the first texture (step 845). These texels 
corresponding to the perspective modulated height field values in the first texture. 

[0091] In step 846, a blending operation is performed that saves the larger of the 

source (i.e. the incoming texel value from the first texture) and destination (frame 
buffer pixel value representing reference height field) to obtain an updated image 
in the frame buffer. The updated image represents a partial orthographic height 
propagation of the perspective modulated height field. 

[0092] In step 847, the first texture is replaced with the updated image. 

[0093] Processing is then repeated for the next height propagation (step 848). In 

particular, steps 845-847 are repeated until the updated image represents a full 
orthographic height propagation of the perspective modulated height field over 
the height field domain. In other words, steps 845-847 are repeated until the 
fixed incremental height propagation has been incremented to reach the outer 
radius or end of the shift disk. As would be apparent to a person skilled in the art 
given this description, each iteration of steps 845-847 can be carried out in a 
different rendering pass by a graphics pipeline. 

(ii) Incremental Height Propagation Varied at Each 
Iteration 

[0094] FIG. 8C shows a routine for carrying out step 420 using a shift disk with 

an incremental height propagation varied at each iteration (steps 840-844 and 
855-859). Steps 840-844 proceed as described above with respect to FIG. 8B. 
Heights are propagated by an incremental distance nAd which varies with each 
iteration. In one embodiment, n =1 during the first iteration and is then 
incremented by 1 in each successive iteration (n=2, 3, ...). In this way, processing 
is saved as more remote radial locations from a viewpoint are sampled less 
frequently. 
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[0095] For each height propagation, texture mapping is performed at the shift 

disk vertices to access corresponding texels in the first texture (step 855). These 
texels corresponding to the perspective modulated height field values in the first 
texture. 

[0096] In step 856, a blending operation operation is performed that saves the 

larger of the source (i.e. the incoming texel value from the first texture) and 
destination (frame buffer pixel value representing reference height field) to obtain 
an updated image in the frame buffer. The updated image represents a partial 
orthographic height propagation of the perspective modulated height field. 

[0097] In step 857, the first texture is replaced with the updated image. 

[0098] In step 858, the shift disk is updated to shift texture coordinates along 

radial directions by an increased incremental distance nAd. 

[0099] Processing is then repeated for the next height propagation (step 859). In 

particular, steps 855-858 are repeated until the updated image represents a fiill 
orthographic height propagation of the perspective modulated height field over 
the height field domain. In other words, steps 855-858 are repeated until the 
fixed incremental height propagation has been incremented to reach the outer 
radius or end of the shift disk. As would be apparent to a person skilled in the art 
given this description, each iteration of steps 855-858 can be carried out in a 
different rendering pass by a graphics pipeline. 



(3) Shift Texture 

[0100] Specifying texture coordinates at vertices leaves it to linear interpolation 

to generate per-pixel texture coordinates. In order for the approximation to be 
good enough, the disk must not be too coarse in tessellation. On graphics systems 
that feature pixel textures or dependent textures (such as an OPENGL system 
v^th pixel texture extension), texture coordinates can be modified per-pixel 
through the use of another texture which stores, instead of color values, texture 
coordinates. A dependent texture for texture coordinate shift s = Ad/L can be 
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computed and applied to rectangular geometry as a cheap and more precise 
replacement of the disk. The approach using iterative replacement of the height 
field texture is more desirable because it requires only one dependent shift 
texture, just as it requires only a fixed shift disk. 

(i) Shift Texture - Incremental Height Propagation 
Fixed at Each Iteration 

[0101] FIG. 8D shows a routine for carrying out step 420 using a shift texture 

with an incremental height propagation fixed at each iteration (steps 842-844 and 
860-869). Steps 842-844 proceed as described above with respect to FIG. 8B, 

[0102] In step 860 , a dependent texture is computed. The dependent texture has 

texels which define a texture coordinate shift of a fixed amount. 

[0103] In step 862, a rectangular geometry is set up to which the dependent 

texture and the first texture are mapped. 

[0104] In step 864, texture mapping is performed. The dependent texture is 

mapped onto the rectangle geometry which modifies (i.e., shifts) the texture 
coordinates for each pixel on the rectangle. 

[0105] In step 865, texture mapping is performed. The first texture is mapped 

onto the rectangle geometry with texture coordinates shifted by the fixed amoimt. 

[0106] In step 866, a blending operation is performed that saves the larger of the 

source (i.e. the incoming texel value from the first textiure) and destination (frame 
buffer pixel value) to obtain updated image in the fi-ame buffer (the updated 
image representing a partial orthographic height propagation of the perspective 
modulated height field). 

[0107] In step 867, the first texture is copied over with the updated image. 

[0108] Processing is then repeated for the next height propagation (step 869). In 

particular, steps 864-867 are repeated until the updated image represents a full 
orthographic height propagation of the perspective modulated height field over 
the height field domain. As would be apparent to a person skilled in the art given 
this description, each iteration of steps 864-867 can be carried out in a different 
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rendering pass by a graphics pipeline using a pixel texture processing, such as, 
OPENGL pixel texture extension. Steps 864-867 are repeated until the updated 
image in a frame buffer represents a full orthographic height propagation of the 
perspective modulated height field over the height field domain. 

C. Hardware-Accelerated Example hnplementation 

[0109] One embodiment is described with respect to a multi-pass routine for 

hardware-accelerated visibility culling 1 000 shown in FIG. 1 0 (steps 1010-1 040). 
FIG. 1 1 shows images representing the resulting height field 1 1 10-1 140 obtained 
after different steps in routine 1000. The white dot indicates the viewpoint (i.e, 
the eye position). Images 1 130 and 1 140 are scaled by four in the figure to aid 
viewing of detail. 

[0110] Routine 1000 lends itself to different mappings onto hardware with 

different features and capabilities. One current implementation uses OpenGL on 
a personal computer (PC) with a 450MHz Pentium III processor and an Nvidia 
GeForce2 graphics card, utilizing only a minimal set of features needed to carry 
out routine 1000. This example implementation is illustrative and not intended 
to limit the present invention. 

[Dili] Steps 1010 and 1020 can be performed in one, two or more passes through 

an OPENGL pipeline. In step 1010, an original height field is drawn into the 
frame-buffer color channels (such as, the red, green, or blue chaimel). The 
intensity of original height field values is shown in image 1110. 

[01 12] In step 1 020, a polygon of the same size as the height field is drawn with 

a constant color value. The constant color value represents the eye height, that 
is, the height at a viewpoint V. The blending function is set to subtract the 
polygon color from the frame-buffer color during the drawing pass. The intensity 
of the resulting height field values (original - eye height) is shown in image 1 120. 

[0113] In step 1030, a drawing pass is performed that includes drawing a 

perspective modulation disk with a 1-D distance texture, setting a blending 
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function to modulate the frame-buffer color with the incoming color, and making 
the resulting image after the blending a texture. This texture represent a 
perspective modulated height field according to one embodiment of the present 
invention. The intensity of the height field values in a perspective modulated 
height field is shown in image 1 130. 
[0114] In step 1040, a number of drawing passes N are made, N being the 

number of propagation steps to be performed. FIG. 9B shows an example texture 
coordinate shift disk. In step 1 040, for n~0 to n<N, a texture coordinate shift disk 
is modified to shift texture coordinates by s = nAd/L during each respective pass. 
'•^ Blending is enabled with a MAX blending function to draw the shift disk with the 

hQ texture generated in step 1 030. This results in a perspective modulated occlusion 

ru 

1 y height field according to one embodiment of the present invention. The intensity 

J"^ of the height field values in a perspective modulated occlusion height field is 

"tsi 

\X\ shown in image 1 140. 

;=~j [0115] An incremental distance Ad of one pixel width was also chosen, which 

jl^ means the amount of texture coordinate shift per step of propagation is ^ = 1 /256. 

r;0. The worst-case scenario for N, the number of propagation steps required, occurs 

when the eye is at one of the comers of the height field, in which case A'^ is the 
diagonal length in units of pixel width, i.e. = 256* . For orthographic height 
propagation, a shift disk is used whose shift is modified for each propagation 
step, since frame-buffer-to-texture conversion can be relatively slow on this 
example graphics system. In one example, both the perspective modulation disk 
and the shift disk are divided into 40 sectors so that the former has 40 triangles 
and the latter 120 triangles (40+2*40=120). 
[0116] The color precision of pixels and texels on a current generation of 

graphics hardware may be limited. I:or example, the maximum resolution of a 
color channel may be only 8 bits. The 1/d function has a very fast fall-off so that 
most heights in perspective-modulated height field are small. Such values use 
only a small portion of the 8-bit dynamic range, which means only a small 
number of height differences can be represented in some embodiments of the 
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present invention. Sixteen 16-bit color channels or greater can largely solve the 
problem in embodiments of the present invention where such bit precision is 
available in the graphics hardware. 

[0117] According to a further feature of the invention, to alleviate or reduce the 

precision problem, the 1/d function is scaled by multiplying a factor fn^fn^^' If, 
after the multiplication, a value in the 1/d function goes above 1, it is clamped to 
1 . The scaling does makes the modulation factors uniformly larger, so that height 
values after perspective modulation spread over in a larger range. Note that 
scaling the 1/d function by a constant factor maintains the property that 
orthographical height propagation after perspective modulation is equivalent to 
a perspective height propagation. 

[0118] Evidently, scaling by ff^ and clamping to I makes the 1/d function a 

constant 1 from d = OXod=ffj.\n other words, when modulated by the scaled 1/d 
function, the heights within radius ^ from the eye are not modified. What this 
means is that, in the subsequent height propagation, within the radius of ff^ the 
original heights are orthographically propagated, not those after perspective 
modulation. Because of this, by scaling one can give up some occlusion generated 
by perspective viewing within the radius ofy^. However, if f^ is kept small, such 
loss is trivial. FIG. 12 compares the 1/d function and the result of scaling by fH 
= 20. 

7- Perspective Modulation/Orthographic Height Propagation Equivalence to 
Perspective Height Propagation 

[0119] As mentioned above, the inventor has recognized that orthographic height 

propagation of a perspective modulated original height field is equivalent to 
perspective height propagation of the original height field. Although 
orthographic height propagation gives overly conservative results on the original 
height field, the present invention introduces a transformation of heights so that 
the orthographic propagation in the transformed height field is equivalent to 
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perspective propagation in the original. In this way, the present invention allows 
orthographic propagation to be directly accelerated through use of texture 
mapping and blending as described above. The transformation basically enables 
one to perform the equivalence of perspective height propagation with hardware 
acceleration. Better still, the transformation itself is also fiilly supported by 
commercially available graphics hardware. 

[0120] FIG. 1 3 shows a point on the X-Y plane, Pf, at distance dpj from the K; 

has height hpi, and its perspective-propagated height, hpj \ at a at distance dp2 
= dpi + A^/, Ac/ ^ 0, along the line passing and F, is 

k[ = (1) 



If hpf ' > hp2, at point a height must only be less than hp, \ instead of hp2, in 
order not to be seen from K; i.e. hp,' is the minimum visible height at Z*^. This is 
simply the effect of perspective projection. Perspective height propagation is to 
compare hp,' with the stored height {hp^ at P^i if the former is greater, then the 
stored value is updated. The propagation starts at the viewpoint and goes from 
near to far in distance. 

[0121] From FIG. 13, one can observe that if 



^P\ > ^P\ .^^^ 



then using equation (1), one has 



I d p2 



or. 



dpi d 



(3) 



P2 
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Clearly, if (3) holds, then (2) does, too. This means that the quantity, ^ ^ ^ j 

at the two points can be directly compared to decided whether the perspective- 
propagated height of one is greater than the original height of the other. In other 
words, if the original height field is transformed by multiplying each height value 
by Vd, then orthographic height propagation of the transformed height field is 
equivalent to perspective propagation on the original. 



8. Example Host and Graphics Subsystem 



[0122] FIG. 14 illustrates an example graphics system 1400 according to an 

embodiment of the present invention. This example graphics system is 
illustrative and not intended to limit the present invention. 

[0123] Graphics system 1400 comprises a host system 1410, a graphics 

subsystem 1420, and a display 1470. Each of these features of graphics system 
1400 is further described below. 

[0124] Host system 1410 comprises an application program 1412, a hardware 

interface or graphics API 1415, and a processor 1416. Application program 1412 
can be any program requiring the rendering of a computer image or scene. The 
computer code of application program 1412 is executed by processor 1416. 
Application program 1412 accesses the features of graphics subsystem 1420 and 
display 1 470 through hardware interface or graphics API 1415. As shown in FIG. 
14, in one example implementation height field visibility culling control module 
505 is control logic (e.g., software) that is part of or accessed by application 1412. 

[0125] Graphics subsystem 1420 comprises a vertex operation module 1422, a 

pixel operation module 1424, a rasterizer 1430, a texture memory 1440, and a 
frame buffer 1450. Texture memory 1440 can store one or more texture images 
1442. Texture memory 1440 is connected to a texture unit 1434 by a bus or other 
communication link (not shown). Rasterizer 1430 comprises texture unit 1434 
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and a blending unit 1436. The operation of these features of graphics system 
1400 would be known to a person skilled in the relevant art given the description 
herein. 

[0126] In embodiments of the present invention, texture unit 1434 can obtain 

either a point sample, a bilinearly filtered texture sample, or a trilinearly filtered 
texture sample firom texture image 1442. Blending unit 1436 blends texels and/or 
pixel values according to weighting values to produce a single texel or pixel. The 
output of texture unit 1 434 and/or blending module 1436 is stored in frame buffer 
1450. Display 1470 can be used to display images or scenes stored in frame 
buffer 1450. 

[0127] An embodiment of the invention shown in FIG. 14 has a multipass 

graphics pipeline. It is capable of operating on each pixel of an object (image) 
during each pass that the object makes through the graphics pipeline. For each 
pixel of the object, during each pass that the object makes through the graphics 
pipeline, texture unit 1434 can obtain texture sample(s) from the texture image 
1442 stored in texture memory 1440. 

[0128] Other embodiments of the present invention can include OPENGL pixel 

texture extension and/or NVIDIA-style texture-dependent texture lookups. 

9. Example Computer System 

[0129] Referring to FIG. 15, an example of a computer system 1500 is shown, 

which can be used to implement computer program product and computer 
program code embodiments of the present invention. This example computer 
system is illustrative and not intended to limit the present invention. Computer 
system 1 500 represents any single or multi-processor computer. Single-threaded 
and multi-threaded computers can be used. Unified or distributed memory 
systems can be used. 
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|0130] Computer system 1500 includes one or more processors, such as 

processor 1504, and one or more graphics subsystems, such as graphics 
subsystem 1505. One or more processors 1504 and one or more graphics 
subsystems 1505 can execute software and implement all or part of the features 
of the present invention described herein. Graphics subsystem 1505 can be 
implemented, for example, on a single chip as a part of processor 1 504, or it can 
be implemented on one or more separate chips located on a graphic board. Each 
processor 1504 is connected to a communication infrastructure 1502 (e.g., a 
communications bus, cross-bar, or network). After reading this description, it 
will become apparent to a person skilled in the relevant art how to implement the 
invention using other computer systems and/or computer architectures. 

(01311 Computer system 1500 also includes a main memory 1508, preferably 

random access memory (RAM), and can also include secondary memory 1510. 
Secondary memory 1510 can include, for example, a hard disk drive 1512 and/or 
a removable storage drive 1514, representing a floppy disk drive, a magnetic tape 
drive, an optical disk drive, etc. The removable storage drive 1514 reads from 
and/or writes to a removable storage unit 1518 in a well-known maimer. 
Removable storage unit 1518 represents a floppy disk, magnetic tape, optical 
disk, etc., which is read by and written to by removable storage drive 1514. As 
will be appreciated, the removable storage unit 1518 includes a computer usable 
storage medium having stored therein computer software and/or data. 

[0132] In alternative embpdiments, secondary memory 1510 may include other 

similar means for allowing computer programs or other instructions to be loaded 
into computer system 1500. Such means can include, for example, a removable 
storage unit 1522 and an interface 1520. Examples can include a program 
cartridge and cartridge interface (such as that found in video game devices), a 
removable memory chip (such as an EPROM, or PROM) and associated socket, 
and other removable storage units 1 522 and interfaces 1 520 which allow software 
and data to be transferred from the removable storage unit 1522 to computer 
system 1500. 
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[0133] In an embodiment, computer system 1 500 includes a frame buffer 1 506 

and a display 1507. Frame buffer 1506 is in electrical communication with 
graphics subsystem 1505. Images stored in frame buffer 1506 can be viewed 
using display 1507. 

[0 134] Computer system 1 500 can also include a communications interface 1 524. 

Commimications interface 1524 allows software and data to be transferred 
between computer system 1500 and external devices via commimications path 
1526. Examples of commimications interface 1524 can include a modem, a 
network interface (such as Ethernet card), a communications port, etc. Software 
and data transferred via communications interface 1 524 are in the form of signals 
which can be electronic, electromagnetic, optical or other signals capable of being 
received by communications interface 1524, via communications path 1526. 
Note that communications interface 1 524 provides a means by which computer 
system 1500 can interface to a network such as the Internet. 

[0135] Computer system 1 500 can include one or more peripheral devices 1 532, 

which are coupled to communications infrastructure 1502 by graphical user- 
interface 1530. Example peripheral devices 1532, which can form a part of 
computer system 1 500, include, for example, a keyboard, a pointing device (e.g., 
a mouse), a joy stick, and a game pad. Other peripheral devices 1 532, which can 
form a part of computer system 1500 will be known to a person skilled in the 
relevant art given the description herein. 

[0136] The present invention can be implemented using software nmning (that 

is, executing) in an environment similar to that described above with respect to 
FIG, 15. In this document, the term "computer program product" is used to 
generally refer to removable storage imit 1 5 1 8, a hard disk installed in hard disk 
drive 1512, or a carrier wave or other signal carrying software over a 
communication path 1 526 (wireless link or cable) to communication interface 
1524. A computer useable medium can include magnetic media, optical media, 
or other recordable media, or media that transmits data. These computer program 
products are means for providing software to computer system 1500. 
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[0137| Computer programs (also called computer control logic) are stored in 

main memory 1508 and/or secondary memory 1510. Computer programs can 
also be received via communications interface 1 524. Such computer programs, 
when executed, enable the computer system 1500 to perform the features of the 
present invention as discussed herein. In particular, the computer programs, 
when executed, enable the processor 1 504 to perform the features of the present 
invention. Accordingly, such computer programs represent controllers of the 
computer system 1500. 

[0138] In an embodiment where the invention is implemented using software, the 

software may be stored in a computer program product and loaded into computer 
system 1500 using removable storage drive 1514, hard drive 1512, or 
communications interface 1524. Alternatively, the computer program product 
may be dovmloaded to computer system 1500 over communications path 1526. 
The control logic (software), when executed by the one or more processors 1 504, 
causes the processor(s) 1504 to perform the ftinctions of the invention as 
described herein. 

[0139] In another embodiment, the invention is implemented primarily in 

firmware and/or hardware using, for example, hardware components such as 
application specific integrated circuits (ASICs). Implementation of a hardware 
state machine so as to perform the functions described herein will be apparent to 
a person skilled in the relevant art. 

10. Conclusion 

[0140] Various embodiments of the present invention have been described above, 

which are capable of being implemented on a graphics machine. It should be 
understood that these embodiments have been presented by way of example only, 
and not limitation. It will be imderstood by those skilled in the relevant art that 
various changes in form and details of the embodiments described above may be 



SKGFRef.No. 1930.0100001 



-37- 



made without departing from the spirit and scope of the present invention as 
defined in the claims. Thus, the breadth and scope of the present invention 
should not be limited by any of the above-described exemplary embodiments, but 
should be defined only in accordance with the following claims and their 
equivalents. 
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